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Abstract: Wo observe n heteroscedastic stochastic processes {Yy(t)}v, 
where for any v G {1, . . . , n} and t G [0, 1], Yv(t) is the convolution product 
of an unknown function / and a known blurring function corrupted by 
Gaussian noise. Under an ordinary smoothness assumption on g\, . . . , gn, 
our goal is to estimate the d-th derivatives (in weak sense) of / from the 
observations. We propose an adaptive estimator based on wavelet block 
thresholding, namely the "BlockJS estimator". Taking the mean integrated 
squared error (MISE), our main theoretical result investigates the minimax 
rates over Bcsov smoothness spaces, and shows that our block estimator 
can achieve the optimal minimax rate, or is at least nearly-minimax in the 
least favorable situation. We also report a comprehensive suite of numerical 
simulations to support our theoretical findings. The practical performance 
of our block estimator compares very favorably to existing methods of the 
literature on a large set of test functions. 
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62F12. 



1 



F. Navarro et al. /Wavelet multichannel deconvolution 



2 



Keywords and phrases: deconvolution, multichannel observations, deriva- 
tive estimation, wavelets, block thresholding, minimax. 



Contents 



1 Introduction 2 

1.1 Problem statement 2 

1.2 Overview of previous work 3 

1.3 Contributions and relation to prior work 4 

1.4 Paper organization 4 

2 Wavelets and Besov balls 4 

2.1 Periodizcd Meyer Wavelets 4 

2.2 Besov balls 6 

3 The deconvolution BlockJS estimator 6 

3.1 The ordinary smoothness assumption 6 

3.2 BlockJS estimator 7 

4 Minimaxity results of BlockJS over Besov balls 8 

4.1 Minimax upper-bound for the MISE 8 

4.2 Minimax lower-bound for the MISE 8 

5 Simulations results 9 

5.1 Monochannel simulation 9 

5.2 Multichannel simulation 10 

6 Conclusion and perspectives 10 

7 Proofs 15 

7.1 Preparatory results 15 

7.2 Proof of Theorem 4.1 20 

7.3 Proof of Theorem 4.2 20 

References 24 



1. Introduction 



1.1. Problem statement 



Suppose that we observe n stochastic processes Yi(<), . . . , Yn{t), t g [0, 1] where, 
for any w G {1, . . . , n}, 

dY,{t)^{f^g,){t)dt + edW,{t), te[0,l], n e N*, (1) 

e > is the noise level, (/ :*r gv){t) ~ J{t — u)gy{u)du denotes the convolu- 
tion product on [0, 1], Wi{t), . . . , Wn{t) arc n unobserved independent standard 
Brownian motions, for any v £ {1, . . . , n}, Qv : [0, 1] — > M is a known blurring 
function and / : [0, 1] M is the unknown function that we target. We assume 
that / and gi, . . . ,g„ belong to Lpgj.([0, 1]) = {h; h is 1-periodic on [0, 1] and 

/p h^{t)dt < oo}. The focus of this paper is to estimate / and its derivatives 
Z^'*^ (to be understood in weak or distributional sense) from Yi{t), . . . ,Yn{t), 
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t e [0,1]. This is in general a severely ill-posed inverse problem. Application 
fields cover biomedical imaging, astronomical imaging, remote-sensing, seismol- 
ogy, etc. This list is by no means exhaustive. 

In the following, any function h E Lpp^([0, 1]) can be represented by its Fourier 
series 

where the equality is intended in mean-square convergence sense, and Fi{h) 
denotes the Fourier series coefficient given by 

F{h){l) = [ h{t)e-^''"^^dt, eeZ, 
Jo 

whenever this integral exists. The notation • will stand for the complex con- 
jugate. 

1 . 2. Overview of previous work 

There is an extensive statistical literature on wavelet-based deconvolution prob- 
lems. For obvious space limitations, we only focus on some of them. 
In the special case where (71 = • • • = 5„, (1) reduces to the form 

dY{t) = {fi.gi){t)dt + tn-^''^dW{t), te[0,l], (2) 

where Y{t) = (1/n) E"=i ^"(*)' and W{t) ^ E"=i W is standard 

Brownian motion. In such a case, (2) becomes the standard deconvolution which 
attracted attention of a number of researchers spanning a wide range of fields 
including signal processing and statistics. For instance, wavelet-based estima- 
tors of / have been constructed and their asymptotic performance investigated 
in a number of papers, see e.g. [4-6, 9, 15, 18]. When 51, . . . ,g„ are not neces- 
sarily equal, estimators of / and their minimax rates under the mean integrated 
squared error (MISE) over Besov balls were proposed in [13, 21-23]. These au- 
thors develop wavelet thresholding estimators (hard thresholding in [13, 23] and 
block thresholding in [21, 22]) under various assumptions on gi,...,g„ (typi- 
cally, ordinary smooth and super-smooth case, or boxcar blurring functions). 

Estimating the derivative of a function on the basis of noisy and blurred ob- 
servations is of paramount importance in many fields such as signal processing, 
control or mathematical physics. For instance detecting the singularities of / or 
characterizing its concavity or convexity properties is a longstanding problem 
in signal processing. The estimation of the derivatives from noisy solutions of 
ordinary or partial differential equations is typical in many areas of mathemat- 
ical physics such as astronomy. The derivatives estimation have already been 
investigated from several standard nonparametric models. If we only restrict 
the review to wavelet methods, we refer to [10] for model (2) and to [7, 8, 25] 
for density estimation problems. 
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1.3. Contributions and relation to prior work 

In this paper, considering an appropriate ordinary smoothness assumption on 

gi, . . . ,5„, we develop an adaptive wavelet-based block estimator of 
from (1), d e N. It is constructed using a periodized Meyer wavelet basis and 
a particular block thresholding rule which goes by the the name of Block JS; 
see [1] for the original construction of BlockJS in the standard Gaussian noise 
model, and [2, 3, 11, 26] for further developments on BlockJS. Adopting the 
minimax approach under the MISE over Besov balls, we investigate the upper 
bounds of our estimator. This is featured in Theorem 4.1. We prove that the 
rates of our estimator are nearly optimal by establishing a lower bound as stated 
in Theorem 4.2. 

Our work is related to some prior art in the literature. To the best of our 
knowledge, the closest ones are those of [21, 22]. For the case where d = and 
the blurring function is ordinary-smooth or super-smooth, [21, 22, Theorems 1 
and 2] provide the upper and lower bounds of the MISE over Besov balls for 
a block hard thresholding estimator from the functional deconvolution model""^. 
These bounds match ours but only for d = 0. In this respect, our work goes 
one step further as it tackles the estimation (with a different wavelet estimator) 
of / and its derivatives. As far as the methods of proof are concerned, we use 
similar tools (concentration and moment inequalities as well as the general result 
in [11]) as theirs for the upper bound, but the proof of the lower bounds are 
different. However unlike [21], we only cover the ordinary smooth convolution, 
while their results apply also to the super-smooth case. On the practical side, 
for d = 0, we will show in Section 5 that BlockJS behaves better than block 
hard thresholding [22, (2.9)] over several test functions that contain different 
degrees of irregularity. 

1.4. Paper organization 

The paper is organized as follows. Section 2 gives a brief account of periodized 
Meyer wavelets and Besov balls. Section 3 states ordinary smoothness assump- 
tion on gi, . . . ,gn, and then constructs the BlockJS-based estimator. The min- 
imax upper and lower bounds of this estimator are investigated in Section 4. 
Section 5 describes and discusses the simulation results, before drawing some 
conclusions in Section 6. The proofs are deferred to Section 7 awaiting inspection 
by the interested reader. 

2. Wavelets and Besov balls 
2.1. Periodized Meyer Wavelets 

Wc consider an orthonormal wavelet basis generated by dilations and transla- 
tions of a "father" Meyer- type wavelet cj) and a "mother" Meyer- type wavelet 

^This is a more general model which reduces to the multichannel deconvolution model 
when observed at a finite number of distinct points, see [21, Section 5] for further details. 
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ip. These wavelets enjoy the fohowing features. 

• They are smooth and frequency band-Uniited, i.e. the Fourier transforms of 
(j) and "0 have compact supports with 

fsuppTO)) C h4^3-\47r3-i], 

[supp {J'ii')) C h87r3-\ -27r3-i] U [2tt3-\8tt3-'^], ^ ' 

where supp denotes the support. 

• The functions (0, are C°° as their Fourier transforms have a compact 
support, and "0 has an infinite number of vanishing moments as its Fourier 
transform vanishes in a neighborhood of the origin: 

x: 

eil}{t)dt = 0, V u e N. (4) 

• If the Fourier transforms of (f) and ■0 are also in C™ for a chosen m e N, then 
it can be easily shown that (j) and ^ obey 

m)\ = o ((1 + , \m\ = o ((1 + liD—i) (5) 

for every < £ R. 

For the purpose of this paper, we use the periodized wavelet bases on the 
unit interval. For any t G [0, 1], any integer j and any k G {0, . . . , 2^ — 1}, let 

0,- = V/^cjy{2H - k), = 2^/2^,(2^-^ _ k) 

be the elements of the wavelet basis, and 

fez fez 
their periodized versions. There exists an integer such that the collection 
{Cfe(-)' ^ G {0, . . . , 2> - 1}; Vrfc(-), J > J*, fc G {0, . . . , 2^ - 1}} forms an 
orthonormal basis of Lpj,j.([0, 1]). In what follows, the superscript "per" will be 
dropped from 4P" and ^p^"^ to lighten the notation. 

Let I > j*, any function h G Lp(,j.([0, 1]) can be expanded into a wavelet series 

as 

2'-l oo 2^-1 

h{t) = am,k(pl,k{t) + E E Pj.k^jAt), t e [0, 1], 

fc=o j=i k=a 



where 



fi _ /■^ _ 



See [20, Vol. 1 Chapter III. 11] for a detailed account on periodized orthonormal 
wavelet bases. 
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2.2. Besov balls 

Let < M < oo, s > 0, 1 < p,r < oo. Among the several characterizations of 
Besov spaces for periodic functions on Lp([0, 1]), we will focus on the usual one 
based on the corresponding coefficients in a sufficiently g-regular (periodized) 
wavelet basis {q = oo for Meyer wavelets). More precisely, we say that a function 
h belongs to the Besov ball ^(M) if and only if \h{t)\Pdt < M, and there 
exists a constant M* > (depending on M) such that the associated wavelet 
coefficients (6) satisfy 

/ \ i/p\ '■^ ^z*" 

Iz" "■" — 1 \ OO I / 2-^ — 1 

k=o J y \fc=o 

< M\ (7) 

with a smoothness parameter < s < g, and the norm parameters p and r. 
Besov spaces capture a variety of smoothness features in a function including 
spatially inhomogeneous behavior, see [20]. 

3. The deconvolution BlockJS estimator 
3.1. The ordinary smoothness assumption 

In this study, we focus on the following particular ordinary smoothness assump- 
tion on 5i, . . . ,5„. We assume that there exist three constants, Cg > 0, Cg > 
and S > I, and n positive real numbers cti, . . . , (T„ such that, for any £ G Z and 
any v e {1, . . . ,ti}, 

This assumption controls the decay of the Fourier coefficients of 51, . . . , (7„, and 
thus the smoothness of gi, . . . , (7„. It is a standard hypothesis usually adopted in 
the field of nonparametric estimation for deconvolution problems. See e.g. [24], 
[16] and [18]. 

Example 3.1. Let . . . ,Tn be n positive real numbers. For any v G {1, . . . , n}, 

consider the square-integrable 1-periodic function defined by 



s.W^-Ee"'*"""'^'"' te[0,i]. 



Then, for any I ^ TL, T[g.u){€) = 2 (l -^A.-K^l^rf) and (8) is satisfied with 
5 — 2 and ct„ = . 
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In the sequel, we set 



n ^ 



For a technical reason that is not restrictive at all (see Section 7), we suppose 
that pn > e. 

3.2. BlockJS estimator 

We suppose that /^'^^ e Lpgj.([0, 1]) and that the ordinary smoothness assump- 
tion (8) holds, where 5 refers to the exponent in the assumption. We are ready 
to construct our adaptive procedure for the estimation of Z'-'^^. 

Let ji = [log2(log p„)J be the coarsest resolution level, and j2 = [(1/(2(5 + 
2d+ 1)) log2(/9„/ log p„)J , where, for any a e M, [aj denotes the integer part of 
a. For any j S {ji, . . . , let L ~ [logp„J be the block size. 

Let Aj — {1, . . . , [2^L~^J } be the set indexing the blocks at resolution 
j. For each j, let {Bj K}K<£A be a uniform and disjoint open covering of 
{0, . . . , 2J - 1}, i.e. U/^e^^ Bj^K = {0, . . . , 2^ - 1} and for any {K, K') G 
with K ^ K', Bjji n Bj,K' = and Ca.id{Bj^K) = L, where Bj^K = {k e 
{0, . . . , 2i - 1}; [K - l)L <k< KL - 1} is the kth block. 

We define the Block James-Stein estimator (BlockJS) of /^''^ by 

f^Kt)= ^n,kcl^nAt) + T. J2 hk^iA^)^ te[0,l], (10) 

where for any resolution j and position k g Bj x within the i^th block, the 
wavelet coefficients of f'^'^^ are estimated via the rule 

with, for any a G M, (a)+ = max(a, 0), A > 0, and Sji,fc and Pj^k are respectively 
the empirical approximation and wavelet coefficients, defined as 



and 



= ^ h h! ^ Jo ' 

Notice that thanks to (3), for any j G {ji, . . . , j2} and k G {0, . . . , 2-' — 1} 
r Vj, = supp(^(0,,.fe)) C [-4^3-i2^\4^3-i2^'i], 

1 =supp(J'(^/>j.fe)) C [-87r3"^2^-27r3"^2J]U [27r3-^2^87r3-^2^']. 
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4. Minimaxity results of BlockJS over Besov balls 
4.1- Minimax upper-bound for the MISE 

Theorem 4.1 below determines the rates of convergence achieved by under 
the MISE over Besov baUs. 

Theorem 4.1. Consider the model (1) and recall that we want to estimate 
with d e N. Assume that {(j^yip) satisfy (5) for some m > d and (8) is satisfied. 

Let be the estimator defined by (10) with a large enough X. Then there exists 
a constant C > such that, for any M>0,p>l,r>l, s>l/p and n large 
enough, we have 

sup e( f' (JWit) - f'^'^Htifd^ < c^„, 

where 

" \ (logp„/p„)2^/(2^+2^+2d+i)^ z/pe [l,2),s > (1/p- l/2)(2<5 + 2d+l). 

Theorem 4.1 will be proved using the more general theorem [11, Theorem 
3.1]. To apply this result, two conditions on the wavelet coefficients estima- 
tor are required: a moment condition and a concentration condition. They are 
established in Propositions 7.2 and 7.3, see Section 7 . 



4.2. Minimax, lower-bound for the MISE 

We now turn to the lower bound of the MISE to formally answer the question 
whether ipn is indeed the optimal rate of convergence or not. This is the goal of 
Theorem 4.2 which gives a positive answer. 

Theorem 4.2. Consider the model (1) and recall that we want to estimate f^'^^ 
with d g N. Assume that (8) is satisfied. Then there exists a constant c > 
such that, for any M>Q,p>\,r>l, s>\/p and n large enough, we have 

inf sup e( f' (f^){t) ~ > c^l 

/(d) /(d)eBj ,,(M) \Jo ^ ' J 

where 

n 

09* - ('^*^-2^/(23+25+2<i+l) * _ 

0=1 

and the infimum is taken over all the estimators of f^'^K 

It can then be concluded fronLThcorcm 4.1 and Theorem 4.2 that the rate 
of convergence ipn achieved by /('^^ is near optimal in the minimax sense. Near 
minimaxity is only due to the case p £ [1, 2) and s > (1/p — 1/2){2S + 2c? + 1) 
where there is an extra logarithmic term. 
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(a) (b) (c) 

Fig 1. Original Signals (a): Wave, (b): Parabolas, (c): TimeShiftedSine. 

5. Simulations results 

In the following simulation study we consider the problem of estimating one of 
the derivatives of a function / from the heteroscedastic multichannel deconvo- 
lution model (1). Three test functions ("Wave", "Parabolas" and "TimeShifted- 
Sine", initially introduced in [19]) representing different degrees of smoothness 
were used (see Fig 1). The "Wave" function was used to illustrate the per- 
formance of our estimator on a smooth function. Note that the "Parabolas" 
function has big jumps in its second derivative. 

We have compared the numerical performance of BlockJS to state-of-the- 
art classical thresholding methods of the literature. In particular we consider 
the block estimator of [22] and two term-by-term thresholding methods. The 
first one is the classical hard thresholding and the other one corresponds to 
the non-negative garrote (introduced in wavelet estimation by [17]). In the se- 
quel, we name the estimator of [22] by 'BlockH', the one of [17] by 'TermJS' 
and our estimator by 'BlockJS'. For numerical implementation, the test func- 
tions were finely discretized by taking T equispaced samples ti = i/T € [0, 1], 
i = 0, . . . ,T — 1. The deconvolution estimator was efficiently implemented in 
the Fourier domain given that Meyer wavelets are frequency band-limited. The 
performance of the estimators are measured in terms of peak signal-to-noise 

ratio (PSNR ^ lOlogio ^^^^^S^'^f^i^vr ) '^'^'^ibels (dB)). For any 
V £ {1, . . . the blurring function g-^ is that of Example 3.1 and was used 
throughout all experiments. 

5.1. Monochannel simulation 

As an example of homoscedastic monochannel reconstruction (i.e. n = 1), we 
show in Fig 2 estimates obtained using the BlockJS method from T = 4096 
equispaced samples generated according to (1) with blurred signal-to-noise ra- 
tio (BSNR) of 25 dB (BSNR = lOlogip ^^=°'<j;^f dB). For d = 0, the 
results are very effective for each test function where the singularities are well 
estimated. The estimator does also a good job in estimating the first and second- 
order derivatives, although the estimation quality decreases as the order of the 
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derivative inereases. This is in agreement with the predictions of the minimaxity 
results. We then have compared the performance of BlockJS with BlockH. The 
blurred signals were corrupted by a zero-mean white Gaussian noise such that 
the BSNR ranged from 10 to 40 dB. The PSNR values averaged over 10 noise 
realizations are depicted in FiG 3 for d = 0, d = 1 and d ~ 2 respectively. One 
can see that our BlockJS thresholding estimator produces quite accurate esti- 
mates of /, /' and /" for each test function. These results clearly show that our 
approach compares favorably to BlockH and that BlockJS has good adaptive 
properties over a wide range of noise levels in the monochannel setting. 

5.2. Multichannel simulation 

A first point we would like to highlight is the fact that some choices of cti , . . . , cr„ 
can severely impact the performance of the estimators. To illustrate this, we 
show in Fig 4 an example of first derivative estimates obtained using BlockJS 
from n = 10 channels with T = 4096 samples and noise level corresponding to 
BSNR=: 25 dB, for (Tv — v (dashed blue) and av randomly generated in (0, -|-oo) 
(solid blue). With ct„ randomly generated, we can observe a significant PSNR 
improvement up to 6.85 dB for the first derivative of TimeShiftedSine. Note 
that this improvement is marginal (about 0.60 dB) for the most regular test 
signal (i.e. Wave). 

We finally report a simulation study by quantitatively comparing BlockJS to 
the other thresholding estimators described above. For each test function, we 
generated T = 4096 equispaced samples on [0, 1] according to (1) with varying 
number of channels ranging from n = 10 to 100. 

Table 1 summarizes the results. It shows in particular that BlockJS consis- 
tently outperforms the other methods in almost all cases in terms of PSNR. As 
expected and predicted by our theoretical findings, on the one hand, the per- 
formance gets better as the number of channels increases. On the other hand, 
it degrades with increasing noise level and/or d. Indeed, the derivatives estima- 
tion for BSNR= 10 dB is rather difficult to estimate, especially for functions 
having highly irregular derivatives such as "Parabolas" (which has big jumps in 
its second derivative, see FiG. 2(d)). 

6. Conclusion and perspectives 

In this work, an adaptive wavelet block thresholding estimator was constructed 
to estimate one of the derivative of a function / from the heteroscedastic multi- 
channel deconvolution model. Under ordinary smooth assumption on gi, . . . , gn, 
it was proved that it is nearly optimal in the minimax sense. The practical com- 
parisons to state-of-the art methods have demonstrated the usefulness and the 
efficiency of adaptive block thresholding methods in estimating a function / and 
its first derivatives in the functional deconvolution setting. 

It would be interesting to consider the case where gy are unknown, which is 
the case in many practical situations. Another interesting perspective would be 
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Fig 2. Original (dashed) and estimated function/derivatives (solid) using the BlockJS esti- 
mator applied to noisy blurred observations shown in (a), (b): d = 0. (c): d = I (d): d = 2. 
From left to right Wave, Parabolas and TimeShiftedSine. 




Fig 3. Averaged PSNR values as a function of the input BSNR from 10 replications of the 
noise, (a): Wave, (b): Parabolas, (c): TimeShiftedSine. From top to bottom d = 0, 1,2. 
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TimeShiftedSine 



0.2 0.4 0.6 0.8 

(c) 




0.35 0.4 

(g) 

Fig 4. Original functions (dashed black) and the estimate for ay = v (dashed blue) and ay 
randomly generated (solid blue) with n = 10 channels, (a)-(c): noisy blurred observations (3 
channels out of 10 shown), (d)-(f) BlockJS estimates of the first derivative. Zoom on the 
estimates (g): Parabolas, (h): TimeShiftedSine. 
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20.74 


21.09 


21.99 


21.73 


TermJS 


54.33 


57.05 


57.96 


58.24 


29.21 


29.38 


29.65 


29.79 


20.57 


20.93 


20.91 


21.51 


TermH 


54.59 


56.96 


57.88 


58.10 


29.60 


29.60 


29.90 


29.94 


20.51 


20.96 


20.84 


21.49 












BSNR= 25 dB 
















d = 


= 






d = 


= 1 






d = 


= 2 




n 


10 


20 


50 


100 


10 


20 


50 


100 


10 


20 


50 


100 


Wave 


BlockJS 


44.04 


51.93 


52.47 


59.76 


30.14 


30.90 


30.90 


35.93 


26.83 


26.83 


26.98 


27.00 


BlockH 


42.12 


51.35 


51.82 


59.73 


28.69 


28.69 


28.72 


35.26 


26.89 


26.85 


26.98 


26.48 


TcrmJS 


41.67 


48.10 


49.44 


52.59 


28.49 


28.69 


28.72 


28.71 


25.25 


26.62 


26.78 


26.94 


TermH 


40.95 


49.03 


50.22 


55.04 


28.69 


28.69 


28.72 


28.72 


25.28 


26.85 


26.98 


26.86 


TimeShiftedSine 


BlockJS 


51.85 


52.33 


55.66 


60.49 


39.48 


41.46 


41.88 


41.92 


27.39 


28.72 


29.05 


35.95 


BlockH 


52.93 


51.51 


55.82 


60.35 


38.68 


41.24 


41.87 


41.84 


26.68 


29.36 


29.54 


35.15 


TermJS 


47.19 


47.83 


54.45 


56.63 


29.46 


41.34 


41.85 


41.79 


23.66 


25.84 


25.95 


27.58 


TermH 


47.54 


47.47 


54.44 


59.63 


31.42 


41.03 


40.75 


41.79 


23.66 


25.69 


25.91 


30.67 


Parabolas 


BlockJS 


47.81 


49.88 


52.90 


54.40 


25.52 


26.11 


28.74 


29.57 


17.48 


18.24 


18.96 


20.62 


BlockH 


47.74 


49.23 


52.00 


53.62 


25.43 


25.16 


29.55 


29.69 


17.08 


18.92 


19.00 


20.63 


TermJS 


44.52 


49.80 


50.80 


52.79 


24.84 


25.78 


25.71 


25.73 


16.39 


18.58 


19.00 


20.57 


TermH 


43.74 


48.84 


51.35 


53.24 


24.86 


25.17 


25.10 


27.98 


16.49 


18.64 


18.95 


20.34 












BSNR= 10 dB 
















d = 


= 






d = 


= 1 






d = 


= 2 




n 


10 


20 


50 


100 


10 


20 


50 


100 


10 


20 


50 


100 


Wave 


BlockJS 


35.82 


43.46 


43.91 


45.95 


26.96 


27.34 


28.22 


28.45 


19.02 


25.12 


26.16 


26.78 


BlockH 


34.08 


43.41 


43.83 


44.60 


26.90 


27.34 


28.19 


28.41 


19.21 


25.16 


26.06 


26.68 


TermJS 


33.30 


43.16 


43.24 


44.48 


26.67 


27.25 


28.14 


28.36 


18.32 


18.89 


22.87 


26.65 


TermH 


33.22 


40.16 


39.32 


44.27 


26.77 


27.35 


28.15 


28.39 


18.61 


19.07 


18.95 


26.68 


TimeShiftedSine 


BlockJS 


38.69 


39.28 


41.24 


48.38 


30.12 


38.85 


39.26 


40.19 


22.58 


22.84 


23.37 


23.53 


BlockH 


38.66 


38.97 


40.12 


45.34 


26.66 


38.22 


39.22 


39.08 


22.58 


22.73 


23.33 


23.48 


TermJS 


38.41 


38.68 


40.31 


41.45 


25.68 


29.24 


36.79 


36.68 


22.52 


22.82 


15.27 


23.26 


TermH 


38.23 


38.44 


39.07 


41.46 


26.98 


28.10 


35.18 


36.98 


22.49 


22.72 


15.47 


17.56 


Parabolas 


BlockJS 


35.26 


37.04 


40.64 


44.74 


22.03 


24.56 


24.77 


25.56 


12.76 


12.79 


13.09 


13.29 


BlockH 


34.12 


35.53 


39.29 


43.41 


22.22 


24.54 


24.47 


25.00 


12.64 


12.76 


12.78 


12.77 


TermJS 


34.29 


35.18 


39.38 


41.37 


21.70 


24.51 


24.63 


24.96 


12.56 


12.76 


12.79 


12.79 


TermH 


33.27 


34.53 


39.45 


42.21 


21.88 


23.98 


24.21 


24.86 


12.70 


12.76 


12.79 


12.79 



Table 1 

Comparison of average PSNR in decibels (dB) over 10 realizations of the noise for d = 0, 
d=l and d = 2. From top to bottom BSNR= 40, 25, 10 dB. 
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to extend our results to a multidimensional setting. These aspects need further 
investigations that we leave for a future work. 

7. Proofs 

In the following proofs, c and C denote positive constants which can take dif- 
ferent values for each mathematical term. 



7.1. Preparatory results 

In the three following results, we consider the framework of Theorem 4.1 and, 
for any integer j > and k e {1, . . . , 2^ — 1}, we set aj^k = Jq f^'''\t)4'j,k{^)dt 
and /3j,fc = f'^'^\t)Tjjj k{t)dt, the wavelet coefficients (6) of f^'^\ 

Proposition 7.1 (Gaussian distribution on the wavelet coefficient estimators). 
For any integer j > and k G {0, . . . , 2^ — 1} , we have 



( 1 " 1 

y v=i ^ i£T)j 



and 



Proof. Let us prove the second point, the first one can be proved in a similar 
way. For any £ G Z and any v <E {l,...,n}, T {f -k g„) {£) = F{f){t) F{gv){t). 
Therefore, if we set 

yi,v^ [' e-^^'''dY,{t), ee^,^ f e~^^'''dW,{t), 
Jo Jo 

It follows from (1) that 

ye,v=HW)H9vm + eei,,. (12) 

Note that, since / is 1-periodic, for any u G {0, . . . , d}, f^"^ is 1-periodic and 
y(")(0) = /(")(!). By classical properties of the Fourier series, for any ^ G Z, we 
have 7'(/(''))(£) = {2^1^ F{f ){t). The Parseval theorem gives 

= /\/^''Hi)v^,,jorfi=E-^(/^'^)w^^w^w 

^" tec, 
tec. 



F. Navarro et al. /Wavelet multichannel deconvolution 



16 



Using (12), wc have 



1 " 1 



' ^(9vm 

leCj 



Since {e '^"^^^ l^gz is slti or thonormal basis of L2^,.([0, 1]) and Wi{t),..., Wn{t) 
are i.i.d. standard Brownian motions, ( e^'^'^^^*^dWy(t)] is a se- 

V-^" J {Lv)£Zx{l,...,n} 

quence of i.i.d. random variables with the common distribution A/'(0, 1). There- 
fore 



Proposition 7.1 is proved. □ 
Proposition 7.2 (Moment inequahties). 

• There exists a constant C > such that, for any integer j > 7* and 

fee {0,... ,2^-1}, 

E(|%^.-«,„..p)<Ce22W)..^-i, 

• There exists a constant C > such that, for any integer j > and 
fcG{0,...,2^"-l}, 



Proof. Let us prove the second point, the first one can be proved in a similar 
way. Let us recall that, by Proposition 7.1, for any j S {ji, ■ ■ ■ , j2} and any 
fc e {0, . . . , 2^ - 1}, we have 

^,,fc-/3,,fc^AA(0,p-V|,fc). (13) 

where 



2 _,2Y^ 1 X"^/o.^.N2d l-^(V'j.fc) 

h^^+^iy'hi \H9vm? 



(14) 
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Due to (8) and (11), for any v e {1, . . . , n], we have 



< C{1 + al)' sup ({2TTe)'''{l + fy) 

< C(1 + CT^)''22('^+'^)J'. (15) 



It follows from (15) and the Parseval identity that 



^^^(l + a2)2^ ,ec, Vl-^(5.)(^)l^ 



lac, 



Jo 

Putting (13), (14) and (16) together, we obtain 



E 



Proposition 7.2 is proved. □ 

Proposition 7.3 (Concentration inequality). There exists a constant A > 
such that, for any j G {ji, . . . , j^}, o-ny K £ Aj and n large enough, 

\ 1/2 

E \hk - I3j,k\' > X2('+^^^\ogpJpn)'/' I < p-' 

Proof. We need the Circlson inequality stated in Lemma?. 1 below. 
Lemma 7.1 ([12]). Let {'&t)t£D be a centered Gaussian process. If 

E (supt?t ) < iV, supV(i?t)<^ 
\teD J teD 



then, for any x > 0, we have 



sup "dt ^ X + N ] < exp 

t<£D 



x^ \ 



- 



2V J 



For the sake of notational clarity, let 
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Recall that, by Proposition 7.1, we have Vj^k ^ Pn^^'^ kj ^ where ct|j, is 

given in (14). Let 1(1) the unit 2-norm bah in C*^ard(s,,;,,)^ i.e. B(l) = {a S 
^Card(B,,K-). Y^kdB.K l"*^!^ - " ^ 1"=* ^(") Centered 

Gaussian process defined by 



Z{a)= ^ akVj 



keBj,K 



n 



By a simple Legendre-Fenchel conjugacy argument, we have 
supZ(a)= ^ \V,^k\A = 5^ 



a6B(l) 



Now, let us determine the values of N and V which appeared in the Cirelson 
inequality. 

Value of N. Using the Jensen inequality and (16), we obtain 

l/2\ / \ 1/2 



e( sup Z(a) I =IE E I^J-.^-l' 



<cLt^ E -M^l <c(p-^£V.2^('+'^^^Card(B,,x))'^' 
Hence iV = Ce2(*'+'^W(logp„/p„)i/2. 

Value of y. Note that, for any {£, f) e and any (w, u') e {1, . . . , n}^, 



E(e£,„e£',i.') 



1 if £ = and iJ = w', 
otherwise. 
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It then follows that 



sup V(Z(a)) = sup E 

aeB(l) oeB(l) 



sup E ^ ^ akttk'Vj.kVj^k' 



n 71 ^ 



aGB(l) 



^ ^ ^ fl + cr2)'5 fl + cr^,)*' 



Havm 

•1 



{2^T^ 



\2d 



'''^ .S. S S I n^vm? 



" 1 



(27r^) 



2d 



aGB(i) rr; 



J2 akTi^P,^k)ii) 



(17) 



For any a G B(l), the Parscval identity and the fact that {4'j.k}k=o,....2i ~i 
are orthonormal yields 



E 



kGBj^K 



E 



2 



akipj,k{t) 

keBj_K 



(18) 



Piecing (15), (17) and (18) together, we get 

sup V(Z(a)) < CeV,T'22(^+'^)J sup ^ 



aeB(l) 



aeB(l) 



keBj^K 



Hence it is sufficient to take V = Ce^ p-'^2'^^^+'^'^^ . 

Taking A large enough and x = 2~^Ae2(''+'')-' (log p„/p„)^/^, the Cirelson in- 
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equality (see Lemma 7.1) yields 

\ 1/2 

\ 1/2 

< I'll E l^^^l'j >2-iAe2(^+'^)^"(logP„/Pn)'/' + A^ 

sup Z(a) >x^n \ < cxp {~x^l{2V)) < exp (-CA^ logp„) 

aeB(l) y 

Proposition 7.3 is proved. □ 



7.2. Proof of Theorem 4.I 

Proof. Plugging Propositions 7.2 and 7.3 into [11, Theorem 3.1], we end the 
proof of Theorem 4.1. □ 

7.3. Proof of Theorem 4.2 

Proof. Let us now present a consequence of the Fano lemma. 

Lemma 7.2. Let to G N* and A be a a-algebra on the space Q,. For any i £ 
{0, . . . , to}, let Ai £ A such that, for any £ {0, . . . , m}^ with i 7^ j , 

A, n Aj = 0. 

Let (Pi)ig{o,...,m} be m + I probability measures on {Q,A). Then 

sup P, {A^) > min (2"\ exp(-3e"i)V^exp(-Xm)) , 

ie{0,...,m} 



where 

Xn 



inf - E 

'ue{0,...,m} TO 



A:G{0,...,m} 



and K is the Kullbak-Leibler divergence defined by 

f f In f In) rfF if P < Q, 
I 00 otherwise. 
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The proof of Lemma 7.2 can be fomid in [14, Lemma 3.3]. For further details 
and apphcations of the Fano lemma, see [26]. 

Consider the Besov balls Bp ,,(M) (see (7)). Let jo be an integer suitably 

chosen below. For any e = {£k)k£{o,... ,2^0-1} & {0, 1}^^" and d G N*, set 

Kit) = M.2-^«(^+i/2) ekj^^_ {x^yf-%,Ay)dy, t G [0,1], 

and, if d = 0, set heit) = M*2-J°(^+i/2) J^lZo^ £k'4>jo.k{t)^t ^ [0, !]• Notice that, 
owing to (5), exists and, since ipj^.k is 1-periodic, so is ft-g. Using the Cauchy 
formula for repeated integration, we have 

2^0-1 

h^f\t) = M,2-^°(^+i/2) £feVjo.fc(i), t G [0, 1]. 

So, for any j > j„ and any k G {0, . . . , 2-' — 1}, the (mother) wavelet coefficient 
of hf is 



Po.k= / hf{t)i^^^S)dt^ 



M,£fc2-^"(«+l/2), if J = jo, 

0, otherwise. 

Therefore hf^ G Bp^(M). The Varshamov-Gilbert theorem (see [26, Lemma 
2.7] ) asserts that there exist a set Ejf, ~ {e'-°^ 7 • ■ • , e^'^-"' } and two constants, c S 
]0, 1[ and a e]0, 1[, such that, for any u e {0,. . . , Tjq}, e'"-* = (£i"')fce{o,...,2Jo-i} G 
{0,1}^^" and any {u,v) G {0,...,rjQ}^ with u < v, the following inequalities 
hold: 

fe=0 

Considering such a set Ej^, for any {u,v) S {0, . . . ,Tjg}'^ with u 7^ u, we have 
by orthonormality of the collection {V'jo.fc}fe=o.... 2^0-1 



2 

dt 



^ 1/2 

fe=0 

, ^ 1/2 

= Af,c2-^°(''+i/2) I '^'|4«)_4-) 

> 2(5j„, 



fc=0 
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where 

<5,„ = M,ci/22^o/22-J«(-+i/2) = Af,ci/22-Jo^ 
Using the Markov inequahty, for any estimator of J^'*-', we have 

SJ,! sup ^( f (W\t)- f(''\t))' dt\> sup ,„,(AS)=p, 
where 

= I (,/^ (i) - h% [t)) ' dt^ < I 

and ¥f is the distribution of model (1). Notice that, for any {u, v) £ {0, . . . , Tjg}^ 
with u 7^ V, A-u n Ay = 0. Lemma 7.2 apphed to the probability measures 



=<"V„e{o,...,T,J 



p> min(2-\exp(-3e-i)V^exp(-XT,j) , (19) 

where 

XT,,= inf J2 ^'Kw^'^c 



ie{o,...,T,-o} 



Let's now bound XTj„ ■ For any functions /i and /2 in Lp(,j.([0, 1]), we have 



= [\iih-h)*9vmfdt. 

The Parseval identity yields 

1 " 

= ^EE™-/2)wi'i-^(ff.)wr 

■0=1 ^ez 

So, for any (u, v) € {0, . . . , Tj^}^ with u ^ v, we have 

1 " 

= ^EEi-^(^ew-^e("))wi'in9.)wr (20) 
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By definition, for any (u, v) G {0, . . . , Tj„}^ with u ^ v and ^ G Z, we have 



2^0-1 



1 



fc=0 



{d-iy. 

Let, for any fc G {0, . . . , 2^° - 1}, 
1 



(21) 



{0 

quently, for any ^ g Z 



(a;-2/)''-V,o,fe(2/)rfy, ie[0,l]. 



Then, for any u e {0, 61^"^ is 1-periodic and 0i"\o) = 6'i"Hl). Conse- 



By virtue of the Cauchy formula for repeated integration, we have 
So, for any £ £ Cjg (excluding 0), (21) implies that 

J-(/l,(„) -/jeM)(^) 

2^0-1 



fe=0 



which entails in particular that supp (J^(/i^(u) — h^(^))) — Cj„. This in conjunc- 
tion with equalities (20) and (22) imply that 



K 



J^'f*_2-2jo(s+l/2) ^ 



2e2 



2^0-1 



fe=0 



(27r£) 



2d 



\H9vm\'. 

(23) 



By assumption (8) and (11), for any v € {1, . . . , n}, 



sup 



1 



(27r£) 



2d I 



\H9vm\'] < C snp 



1 



(2n£) 



2d 



< Ca-^' sup U-^i'+d)) <Ca-2*2"2jo(5+d). 



(24) 
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Moreover, the Parseval identity and orthonormality of the family {V'jo,fc}fc=o 2^0-1 
imply that 



E 



2^-1 



fe=0 



2^0-1 



fe=0 



2^0-1 



dt-Y. 4"^ - 4"0 ^ 2- 



fc=0 



(25) 



It follows from (23), (24) and (25) that 
Hence 



inf 



- E 



^e{o,...,T,o} 



< c'p*2^^^°("+^/^+''+'')2-'«. (26) 
Putting (19) and (26) together and choosing jo such that 

2-jo(.+i/2+i+d) ^ co(p:)-i/^ 

where cq denotes a well chosen constant, for any estimator of /'■'*-', we have 
(5-2 sup e(^/" Cf^Kt) - f^'^Kt))^ dt] > ccxp((a/2)2J" -Cc22J") 



where 



> c. 



5,, = c2-^»^- = c(p:J-'/(2-'+2^+2'*+i). 



This complete the proof of Theorem 4.2. 



□ 
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